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( 1 ) 


Parametric cost models are not a recent development. If Cheops 
thought about cost at all when building the Great Pyramid he would have 
used expressions of the type Y = aX where X equals some parameter such 
as blocks of granite or number of slaves. Most estimating over the 
centuries and even today is in terms of cost per pound, cost per foot, 
cost per barrel or some other simple unit of measurement, all of which 
are simple parametric cost models. They were not recognized as such, 
and it seems to me it was not until the early 1960's that the term 
parametric cost model became part of the vocabulary of the defense 
community. Since then Rand and a number of other organizations have 
been diligently cultivating this field, and parametric cost models have 
grown in complexity and rigor to the point where they qualify for a 
session at an international meeting such as this one. 

The limited time makes it necessary to limit the scope of this 
presentation, so my remarks will be limited pretty much to aircraft cost 
modelsp by extension they apply to weapon systems in general. Even the 
subject^of aircraft cost models is a broad one. This display lists some 
of the models in use today. 
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Each has its uses, and sometimes those uses are different from what 
was originally intended. In Rand reports on cost models, for example, 
you will always find a phrase warning the reader that the model is intended 
for use in long-range planning studies. The warning is sincere, but we know 
that the models are used for a variety of other purposes. They are used 
because the inputs can be obtained easily, the time and expense are minimal, 
and for DoD agencies generally there is no alternative. A grassroots estimate 
of the kind performed by industry is outside the capability of the military 
services. 

The Air Force recognized the need for parametric cost models shortly 
after it was organized. In 1947 the Air Force published Source Book of 
World War II Basic Data: Airframe Industry [1], which presented a number 
of learning curves relating direct hours per pound of airframe weight to 
the cumulative number of aircraft produced. 











1947 CURVES 
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For quite a few years direct factory hours were estimated - not 
too badly - from models of that type. Most of the early statistical 
analyses focused on direct factory labor and learning curves. A 1956 
Rand report, Cost-Quantity Relationships in the Airframe Industry [2], 
concentrated on how to estimate the slope of the learning curve, i.e., 
the b-value in the expression Y = ax* 5 , rather than the a-value, which 
is the direct hours per pound. The Air Force, however, continued to 
publish industry-wide data showing that direct labor hours were increas¬ 
ing. By 1960 the industry average for Century-series fighters was 
25.86 an i ncrease 0 f 40 percent over the 1947 figure. That 

raised the question of why Century-series fighters should require more 
direct labor than other fighters, and for that matter why bombers required 
more than transports. 

With curves of the type shown no distinction was made between a 
10,000-lb fighter and a 15,000~lb fighter; both had the same hours/pound. 
But the labor content of an item does not usually increase proportionately 
with weight. The relative positions of the fighter, bomber, and transport 
curves are due more to their iiffering sizes than to inherent differences 
in design. 
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In looking at a plot of airframe data it was clear that fighters, 
bombers, and transports were not separate samples. A plot from a 1962 
Rand report [3], shows that all three types are close to a regression 
line for subsonic aircraft. Supersonic aircraft with one exception are 
all above the line, thus suggesting that the critical distinction is 
speed, not type. When speed was added as another independent variable, 
it proved to be statistically significant, and the era of statistically 
derived parametric cost models had arrived at Rand. 

The year was 1962, and statistics had not been a prominent feature 
of earlier cost analyses for several reasons. First, and this problem 
has not changed much, the data available were frequently too sparse to 
support statistical analysis. Statisticians were attracted to the reams 
of data published by the Air Force on World War II and post World War II 
aircraft, but more pressing questions of the 1950's and early 1960's 
concerned ballistic missiles and space systems. Parametric cost models 
were based on curves drawn through three, two, or sometimes one point. 

A second reason that statistical analysis was not common will be 
appreciated only by those who can remember back to the pre-computer age. 
Several laborious hours on a Friden calculator were required to do what 
can be done today in five minutes on a pocket-sized hand calculator. The 
sheer volume of calculations required had a strong inhibiting effect on 
researchers. 
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For those who tend to confuse their mantissas with their character¬ 
istics the author produced a nomograph. The answers can be read directly, 
albeit imprecisely, by placing a straight-edge from X 2 to X^. For example, 
the TFX, later to become the F-lll, was a topic much discussed in 1962 
because of controversy over cost and the awarding of the contract to General 
Dynamics instead of Boeing. Use of this nomograph would have given an esti¬ 
mate of approximately 200,000 direct labor hours or 6 hr/lb for the 100th 
unit. 













(7) 

That estimate is shown here along with the contractors' estimates and 
the actual. Although the parametric estimate is low it gave notice at the 
time that the bid estimates were questionable. 








-15- 


* 


O ° 

o o 

o *- 

CO +-» 

£ 'E 

O D 

Q) +■* 

+-» co 

l€ 


05 O 

^ to 


£ 1 

c/> </> C 

W > £ 2 

t) 31 _ 

+; +5 q, T3 

-c c .S' c 

O) o’ 4 " CO 

il o cc 


O 00 

csi co 


IN 

O 

CNJ 

CNI 

CNJ 


CO 

CO 

CO 

CO 

O) 

o 

0) 

cn 

0) 

r- 

r— 

r- 

r* 

r- 


u) 5 

•E £ 

§ § 

CD C3 


Observed 1968 7.0 






-16- 


( 8 ) 


A few years later the computational problem was solved as computers 
and statistical programs became available and were relatively cheap to use. 

The data problem remained as intractable as ever because manufacturers of 
military equipment prefer not to disclose their costs to anyone, and costs 
reported to the government are seldom the kind needed by analysts. One 
effect of that was to continue working on aircraft airframes where Rand had 
compiled a substantial data base over the years. 

The result was a 1966 report [4] that presented a complete parametric 
cost model for the development and production of airframes. It followed the 
general pattern of the earlier study, but despite a search for additional 
independent variables that would explain more of the variance, the conclusion 
was that weight and speed (or thrust as a proxy for speed) were still the 
only two that could be justified statistically. 

Not everyone shared that conclusion. OSD/Systems Analysis gave Planning 
Research Corporation a contract to develop an airframe model at about that 
time, and that model had a variety of interesting variables [5]. Some were 
judgmental rather than statistically significant, but statistical purity is 
not an essential feature of parametric cost models. Too much insistence on 
it results in the elimination of useful variables. Figure 8 lists the PRC 
variables and the cost elements they are associated with. Note that speed 
at sea level was found to be a better explainer of direct labor hours than 
speed at altitude, but the opposite was true for the other three cost elements. 
The ratio -*■ * - was an attem P t to deduce some¬ 

thing like a complexity factor into the model. The model asserts that devel¬ 
opment costs of Naval aircraft are substantially higher than those of Air 
Force aircraft; and if the user is unable to estimate weight growth, the model 
will make that estimate for him. All in all it was a useful model for its time, 
but it did not establish a pattern for future work. 
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(9) 

Rand continued to update its airframe models but without any change 
in format. The reason was that contractors traditionally report costs by 
functional cost element and that is the way the Air Force prefers to 
estimate them. The accuracy of the overall estimate is always better, 
however, than the accuracy of the individual elements, because the data 
are inconsistent at the cost-element level. What one company calls 
engineering another company calls tooling, or a given company will change 
definitions to conform to cost-accounting standards, and it has never been 
possible to adjust the data to eliminate all discrepancies. At the highest 
level - aircraft cost - comparisons are most valid. 

The U.S. Navy contracted to have an airframe model developed in 1972 
that had only two cost elements - nonrecurring and recurring costs [6]. A 
second major change is that a novel index of technological advance was 
introduced, and a third was that a judgment about complexity was required 
of the user. The index of technological advance was truly innovative. A 
review of technological advances had led to the conclusion that they were 
occasioned in most cases by the demand for increased fighter performance. 
From that conclusion it was reasoned that the introduction of every new 
fighter was a step forward in technology. An index was put together 
beginning with the Nieuport 11 in 1915 and extending up through the F-14. 

To estimate airframe cost an index number could be inferred from that list. 
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( 10 ) 


That index and the judgmental complexity factor get at the root of 
the estimating problem. Physical and performance factors such as weight 
and speed are not sufficient in themselves to deal with next generation 
aircraft, but some judgmental factors are too unreliable to include in a 
parametric cost model. I tried an experiment at Rand several years ago 
in which several engineers considered knowledgeable about aircraft were 
asked to examine plots showing actual data on a sample of aircraft plus 
an estimate based on a cost model having only weight and speed as inputs. 
Here is one of the plots for the C-5A. On the basis of that information 
and all of their hindsight the engineers were asked whether the estimate 
should be adjusted and if so, how? Perhaps the experiment was poorly 
devised, but the results seemed to say that judgment is as likely to 
degrade the estimate as to improve it. 
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What the estimating world is continually looking for is something 
like the Time-of-Arrival equation developed at Rand a few years ago for 
military jet engines [7]. That equation combines a number of engine 
characteristics - turbine inlet temperature, total pressure, weight, 
specific fuel consumption, and maximum thrust - to get what is in effect 
a technological index. 







AIRCRAFT TURBINE ENGINE TIME-OF-ARRIVAL (TOA) EQUATION 
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( 12 ) 


That index, TOA, was then used in an engine cost model with not 
completely satisfactory results [8]. One problem with variables based 
on time is that they must be updated every year or two or the estimates 
begin to deteriorate. 

A similar index was developed at Rand for fighter aircraft [9] 
that attempted to predict first flight date based on a combination of 
performance variables. The best equation included specific power, sus¬ 
tained load factor, frequent range, payload fraction, and carrier capa¬ 
bility. Unfortunately, technological advance as measured by those var¬ 
iables appeared to be totally unrelated to aircraft cost. 
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(13) 


The Rand engine model was based entirely on statistical analysis. 

An alternative approach being pursued at about the same time by the 
Naval Air Development Center was to begin with a hypothesis about the 
factors that should influence R&D cost and to establish a parametric 
relationship without regard to the coefficients. The hypothesis is 
shown here. The first independent variable says that turbine inlet 
temperature governs engine performance and dictates engine complexity. 

The second says that the development effort required to achieve a specific 
TIT reduces with time. The third stipulates that afterburning engines 
cost more to develop because of the additional design and testing required. 

Regression analysis was then used to determine whether the three 
hypotheses could be justified, and a useful parametric cost model was 
obtained [10], 
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"Useful" in this context means useful for trade-off studies of 
next-generation aircraft where relative costs are more important than 
absolute costs. Such models are useful for detecting gross discrepancies 
in estimates by advocates of a particular model or system. And they are 
useful where the only information available is a few key parameters such 
as weight, speed, thrust or range. By and large they are developed by 
statistical analysis of experienced costs. 

The goal for such models is to achieve an accuracy of plus or minus 
20 percent. This chart shows for a sample of six airframe models how 
often that goal is achieved [11]. Deviations on the A-7 also show inad¬ 
vertently how getting consistent data is a continuing problem. We had 
queried the manufacturer specifically about the engineering hours in our 
data base for the A-7 because they seemed abnormally low. After the 
report from which this table is taken was published we discovered that 
because of confusion over definitions about 1.5 million engineering hours 
had been excluded. Their inclusion would reduce the A-7 deviations sub¬ 
stantially. 

The time trend is encouraging. When the A-7 is disregarded, the 
deviations exceeding 20 percent drop from fo’^r in the first Rand model to 
zero in the second Noah model. The good score achieved by the latter is 
based on being able to distinguish between a major technology advance and 
a moderate technology advance before an aircraft begins development. My 
experience is that such judgments are often fallacious, but the point of 
the chart is that we are making progress. 
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development and production cost of 100 aircraft. 
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For this type of model that requires only a few inputs early in a 
weapon system's life-cycle I am not sure that much improvement is possible. 
Their great advantage is that they implicitly assume that a development 
program will have its full share of problems and that production will not 
be at a highly efficient rate. More detailed models take into account 
design differences, schedule, volume of business, and a number of other 
program-peculiar characteristics. They offer a promise of greater accuracy, 
but also of greater inaccuracy if early assumptions are over-optimistic. 

The trend towards greater detail and complexity is the path of evolution. 
One-celled models evolve into two-celled models and eventually, if you agree 
with the theory of natural selection, you could have a model the size of the 
woolly mastodon, which would probably receive the same fate. Let me note 
that parametric cost models are developing in another way as well. They are 
being used for many purposes far removed from weapon systems - for estimating 
the costs of new industrial cities in Saudi Arabia to give one example. Thus, 
old problems may have been solved, but new ones are taking their place. I am 
sure that you people with your fresh ideas and new techniques will progress 
more quickly toward solutions than we have in the past. 
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